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INTRODUCTION 


This  research  project  focuses  on  prostate  cancer,  a  devastating  socioeconomic  disease,  whose  detection  is 
plagued  with  inadequate  sensitivity  and  specificity.  Hypoxia  is  the  hallmark  of  malignancy  because  aggressive 
cancers  outgrow  their  blood  supply.  Optical  imaging  is  emerging  as  a  physiologic  tool  capable  of  quantifying 
hypoxia  but  only  at  centimeter  spatial  resolution  which  is  unacceptable  for  prostate  cancer  imaging.  We 
ultimately  aim  to  build  an  instrument  that  combines  OPtics  and  UltraSound  (OPUS)  to  quantify  hypoxia  via 
optical  imaging  but  with  the  improved  spatial  resolution  of  US  imaging.  Specifically,  the  acousto-optic  effect  will 
be  used  to  only  modulate  light  (at  the  ultrasound  frequency)  which  propagates  through  a  small  ultrasound  focal 
zone.  Optical  images  generated  from  only  ultrasound-modulated  light  will  thus  have  the  improved  spatial 
resolution  of  the  ultrasound  focal  zone.  The  main  difficulty  is  the  detection  and  discrimination  of  ultrasound- 
modulated  light  from  the  overwhelming  presence  of  non-modulated  light  not  passing  through  the  ultrasound 
focal  zone.  This  DOD  Idea  Development  Award  is  concerned  with  the  development  of  a  novel  detection  idea 
based  on  quadrature  measurements  with  a  gain-modulated  image  intensified  CCD  camera.  Furthermore,  we 
proposed  the  novel  idea  of  using  microbubble-based  contrast  agents  to  significantly  increase  the  light 
modulation  and,  moreover,  the  use  of  fluorescent  microbubbles  to  provide  additional  enhancement. 

BODY 

The  Statement  of  Work  outlined  four  main  tasks  for  this  project.  The  following  describes  the  research 
conducted  to  date  for  each  task: 

First  Year 


Task  1.  Prove  that  modulating  optical  signal  amplification  with  the  US  frequency  to  preferentially 
amplify  the  modulated  photons  results  in  improved  SNR. 

For  acousto-optic  imaging,  the  size  and  location  of  the  US-focal  zone  provides  the  image  spatial  resolution  and 
the  optical  detector  is  simply  used  to  collect  as  many  modulated  photons  as  possible  to  improve  SNR.  For  the 
detection  of  ultrasound-modulated  coherent  light,  simple  use  of  a  collection  lens  to  focus  many  speckles  to  a 
single  detector  results  in  phase-cancellation  which  ultimately  eliminates  the  modulation  signal  rather  than 
increasing  it.  Hence,  some  researchers[1]  have  used  a  CCD  camera  for  parallel  detection  where  each  pixel 
acts  as  an  independent  detector  to  detect  a  larger  number  of  speckles.  However,  since  the  frame-rates  of  CCD 
cameras  are  not  capable  of  monitoring  the  speckle  modulation  via  ultrasound  (MHz)  in  real-time,  some 
researchers[2]  examine  the  speckle  contrast  of  a  single  CCD  frame  which  is  inversely  proportional  to  the 
magnitude  of  the  acousto-optic  effect. 

As  hypothesized  in  task  1 ,  we  expected  the  use  of  an  image  intensified  CCD  camera  gain-modulated  at  the 
ultrasound  frequency  would  lead  to  a  greater  change  in  the  speckle  contrast  correlated  with  increasing  the 
detector  gain.  These  initial  experiments  employed  a  laser  diode  (5  mW  at  650  nm,  coherence  length  of  ~5  M) 
to  illuminate  a  water  tank  (65  mm  wide)  to  which  we  added  varying  amounts  of  intralipid  as  an  optical  scatterer. 
Light  was  detected  with  a  gain-modulated  image  intensifier  (Picostar  HRI,  LaVision,  Germany)  with  a  highly 
sensitive  electron-multiplying  CCD  camera  (Andor,  CA)  to  detect  the  output  of  the  image  intensifier  and  store  it 
on  the  acquisition  computer.  Modulation  of  the  image  intensifier  gain  was  achieved  with  a  function  generator 
(Stanford  Research  Systems,  DS345)  outputting  a  sine  wave  at  the  ultrasound  frequency  and  phase-locked 
(AO  =  0)  to  a  second  identical  function  generator  input  to  an  RF  Amplifier  (ENI,  240L)  to  drive  a  single-element 
ultrasound  transducer  (Panametrics,  V303)  with  a  1  MHz  sine  wave  (50  Vpp)  with  20  pulses  (20  ps  pulse- 
length)  every  millisecond  (2%  duty  cycle).  The  US  transducer  was  submerged  in  the  water  tank  such  that  its 
focal  zone  (mechanically  focused  to  1 .5  inches)  intercepted  the  line-of-sight  between  the  laser  diode  and  the 
image  intensifier  in  transmission  mode.  Since  speckles  are  typically  around  10  pm  (similar  size  to  8pM  CCD 
pixel)  we  used  an  extension  tube  (PN-1 1 ,  Nikon)  and  50  mm  f/1 .4  Lens  (Nikon)  to  achieve  1:1  imaging  (i.e.  8 
pm  spatial  resolution)  over  an  8  x  8  mm(1000  by  1000  pixels)  field  of  view.  The  experimental  configuration  is 
shown  in  Figure  1 . 
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Figure  1  a)  Experimental  configuration  for  acousto-optic  detection  with  gain-modulated  image  intensifier 

1b)  Schematic  representation 


A  baseline  measurement  was  first  performed  with  no  gain  modulation,  i.e.  a  steady-state  gain,  with  and  without 
the  ultrasound  being  applied  to  measure  the  change  in  speckle  contrast.  The  image  intensifier  was  set  to  300 
V,  the  CCD  integration  time  to  400  ms,  and  100  sequential  images  were  acquired.  The  speckle  contrast  is 
defined  as  the  standard  deviation  of  the  image  intensity  (a)  divided  by  the  mean  intensity  (<l>).  Without 
ultrasound  we  measured  an  average  speckle  contrast  of  0.03557  and  with  ultrasound  an  average  speckle 
contrast  of  0.03548  demonstrating  the  decrease  as  expected.  However,  upon  further  analysis  we  found  the 
standard  deviation  in  the  speckle  contrast  across  the  100  images  was  0.0002  and  so  this  decrease  was  within 
the  measurement  error.  We  explored  a  variety  of  image  intensifier  voltages  and  CCD  integration  times  but 
were  unable  to  detect  any  statistically  meaningful  difference  in  the  speckle  contrast  with  and  without  ultrasound 
being  applied.  This  result  was  somewhat  surprising,  but  undaunted  we  proceeded  to  try  and  detect  a  change  in 
speckle  contrast  when  applying  a  gain-modulation  to  the  image  intensifier.  The  image  intensifier  is  comprised 
of  a  microchannel  plate  (MCP)  held  at  a  high  amplification  voltage  and  a  photocathode  whose  response  is 
modulated  by  the  function  generator.  Unfortunately,  even  with  full  modulation  of  the  photocathode  we  were  still 
unable  to  detect  any  difference  in  the  speckle  contrast  with  and  without  ultrasound  being  applied.  This  result 
was  unexpected  and  somewhat  concerning,  causing  us  to  recheck  that  the  equipment  was  indeed  operating 
correctly. 


At  this  stage  of  the  project  we  had  been  unable  to  detect  the  elusive  ultrasound-modulated  photons  and 
decided  to  simplify  the  set-up  to  a  more  basic  experimental  configuration.  The  gain-modulated  image 
intensified  CCD  was  replaced  with  an  amplified  (20  dB)  silicon  photodetector  (PDA36A,  ThorLabs).  Although 
this  is  essentially  only  one  pixel  compared  to  the  CCD  camera,  it  has  sufficient  bandwidth  (MHz  range)  to 
follow  the  signal  in  real  time  which  the  CCD  cannot.  Unlike  the  previous  experiment  which  resolved  individual 
speckles,  we  simply  detected  all  the  transmitted  light  over  ~  1  cm2  area.  The  output  of  the  silicon  photodetector 
was  further  amplified  and  passed  through  a  high  pass-filter(Stanford  Research  Systems,  SR560),  >10  KHz,  to 
remove  DC  and  low  frequency  noise  before  being  recorded  on  a  digital  scope  (Tektronix,  TDS  201 2B).  Under 
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this  experimental  configuration,  Figure  2a,  we  were  finally  able  to  detect  the  ultrasound-modulated  optical 
signal  which  was  recorded  on  the  scope  (Fig.  2b).  A  Fourier  transform  of  this  signal  (Fig.  2c)  clearly  shows  a 
peak  at  1  MHz  (the  ultrasound  frequency)  where  the  amplitude  is  proportional  to  the  magnitude  of  the  acousto¬ 
optic  effect.  As  a  control,  the  measurement  was  repeated  without  the  ultrasound  being  applied  for  which  there 
was  no  modulation  detected  in  the  optical  signal. 
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Figure  2a)  Experimental  set-up  for  detection  of  ultrasound-modulated  coherent  light  with  a  silicon  photodetector 
2b)  Optical  modulation  detected  and  recorded  on  the  digital  scope. 

2c)  Fourier  transform  demonstrating  optical  modulation  is  at  the  US  modulation  frequency. 


This  experimental  result  is  critical  and  demonstrates  that  we  can  detect  ultrasound-modulated  photons  when 
all  the  individual  speckles  are  spatially  integrated  on  the  detector.  As  discussed  above,  the  spatial  integration 
of  random  speckles  leads  to  phase-cancellation  which  should  destroy  any  modulation.  This  led  us  to  speculate 
that  the  modulation  observed  here  is  not  due  to  modulated  speckles,  caused  by  modulating  the  interference 
pattern  of  coherent  photons,  but  rather,  due  to  modulation  of  the  local  optical  attenuation  which  essentially 
modulates  the  intensity  of  the  photons  in  phase.  The  optical  attenuation  can  be  modulated  via  changes  in  the 
refractive  index,  optical  absorption  and  scattering,  and/or  density  of  scatters  by  the  ultrasound  wave. 
Furthermore,  modulation  of  the  optical  attenuation  should  modulate  photon  intensity  regardless  of  whether  the 
photons  are  coherent  or  incoherent. 

To  date,  most  acousto-optic  researchers[1]  have  relied  upon  the  use  of  coherent  photons  with  the  necessity  for 
photon  coherence  from  optical  source  to  ultrasound-focal-zone  to  optical  detector  imposing  a  requirement  on 
the  laser  to  have  a  long  coherence  length  (at  least  as  long  as  the  optical  pathlength).  For  highly  scattering 
media,  the  optical  pathlength  can  easily  reach  six  times  the  geometrical  distance[3]  restricting  the  choice  of 
available  lasers.  The  ability  to  intensity-modulate  incoherent  photons  with  ultrasound  removes  this  constraint 
permitting  a  wider  range  of  optical  sources  to  be  considered.  Moreover,  since  the  fluorescence  process  is 
inherently  incoherent,  it  allows  the  potential  for  ultrasound-modulation  of  fluorescence  photons.  We  therefore 
modified  our  experimental  set-up,  Figure  3a,  to  demonstrate  the  detection  of  ultrasound-modulated  incoherent 
photons.  We  simply  replaced  our  coherent  laser  diode  (Figure  2a)  with  an  incoherent  light  source  (100  W 
Halogen  Lamp,  Schott  KL1500).  As  expected,  Figure  3b  show  the  detected  and  recorded  modulation  of  the 
optical  signal  which  exhibits  modulation  at  the  ultrasound  frequency  of  1  MHz.  Note,  the  envelope  is  caused  by 
a  lower  frequency  modulation  from  the  lamp  that  was  not  blocked  by  our  frequency  filter. 
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Figure  3a)  Experimental  set-up  for  AO  measurements  of  ultrasound-modulated  incoherent  light. 
3b)  Optical  modulation  at  1  MHz  detected  and  recorded  on  the  digital  scope. 


Although  we  did  not  detect  the  expected  change  in  speckle  contrast  and  could  therefore  not  demonstrate  an 
improvement  in  SNR,  this  research  led  to  the  novel  ultrasound-modulation  of  incoherent  photons.  Moreover, 
the  idea  that  all  the  photons  are  modulated  in  phase  by  modulation  of  the  optical  attenuation  explains  why  we 
did  not  observe  any  change  in  speckle  contrast  when  applying  ultrasound.  The  decrease  in  speckle  contrast 
from  coherent  photons  by  the  addition  of  ultrasound  observed  by  others[2]  relies  on  the  principle  that  the 
standard  deviation  of  the  intensity  decreases  while  the  average  intensity  remains  unaffected  as  all  the  random 
phases  of  the  speckles  cancel  out.  However,  a  modulation  of  the  optical  attenuation  by  ultrasound  causes  an 
in  phase  intensity  modulation  which  simply  scales  the  standard  deviation  and  average  intensity  such  that  the 
speckle  contrast  remains  unchanged  as  we  observed. 


Task  2.  Prove  that  the  use  of  a  Picostar  camera  system  and  a  quadrature  technique  results  in  faster 
data  acquisition  without  loss  of  SNR. 

Particularly  novel  to  this  project  is  the  proposed  quadrature  detection  of  ultrasound-modulated  photons  with  a 
gain-modulated  image  intensifier  to  detect  ultrasound-modulated  photons[4].  Here,  a  continuous  wave  laser 
source  is  employed  and  the  gain  of  the  optical  detector  is  modulated  at  the  same  frequency  as  the  ultrasound. 
The  CCD  image  is  then  acquired  at  four  different  phase  shifts  between  the  optical  detector  modulation  and 
ultrasound  modulation.  The  idea  is  inspired  by  the  way  wide-field  fluorescence  lifetime  imaging  microscopy 
(FLIM)  is  performed[5].  For  this  application,  Fig.  4,  a  modulated  (~  hundreds  of  MHz)  light-emitting  diode  (LED) 
source  is  employed  to  excite  a  fluorophore  resulting  in  a  modulated  fluorescence  signal  where  the  fluorophore 
lifetime  induces  a  phase  shift.  Hence,  the  measurement  of  phase  shift  at  each  pixel  enables  a  fluorescence 
lifetime  image  to  be  generated. 


Figure  4.  FLIM  system  setup:  Wide-field  fluorescence  microscope  and  UFA  attachment  for  FLIM 


The  measurement  of  phase  shift  is  achieved  by  modulating  the 
photocathode  of  the  image  intensifier  at  the  same  frequency  as 
the  LED.  The  resultant  signal  detected  on  the  CCD  pixel  is  thus  a 
product  of  the  phase-shifted  fluorescence  signal  and  the  optical 
detector  sensitivity.  However,  a  time-averaged  signal  is  recorded 
since  a  CCD  does  not  have  sufficient  frame-rate  to  follow  this 
signal.  Nevertheless,  by  acquiring  this  signal  at  four  different 
phases,  Fig  5,  one  is  able  to  measure  the  cross  correlation  of  the 
fluorescence  signal  and  the  optical  detector  sensitivity.  The 
cross-correlation  enables  the  amplitude  and  phase  shift  of  the 
fluorescence  signal  and  hence  the  fluorophore  lifetime  to  be 
measured. 


Figure  5.  Cross-Correlation  Principle 

For  acousto-optic  imaging,  one  can  simply  substitute  the  fluorescence  signal  in  the  FLIM  example  with  the 
ultrasound-modulated  light  signal  (albeit  at  1  MHz  not  hundreds  of  MHz).  Thus  the  amplitude,  A,  of  the 
acousto-optic  effect  can  be  calculated  directly  from  the  following  equation: 

7  =  50-5180 

Q  =  590-5270 

^=V(/2+e2) 

where  Sn  is  the  CCD  image  acquired  for  a  given  phase-shift  of  n  degrees. 

For  ultrasound-modulated  incoherent  light  the  photons  are  modulated  in  the  US  focal  zone  due  to  a  modulation 
in  the  optical  attenuation.  Since  photons  then  take  different  pathlengths  from  the  US  focal  zone  to  the  optical 
detector  there  are  still  residual  phase  differences  in  the  resultant  optical  signal  which  could  be  corrected  for 
with  this  technique.  However,  at  1MHz  these  phase  differences  were  found  to  be  negligible,  especially 
compared  to  those  typically  found  in  standard  frequency  domain  optical  imaging  using  a  modulated  laser 
source  and  conducted  at  hundreds  of  MHz  [6].  Hence,  even  without  performing  phase-alignment,  the  spatial 
integration  of  the  signal  from  this  large  area  detector  is  still  a  preferable  and  more  efficient  option  for  capturing 
the  ultrasound-modulated  photons  than  using  a  small  area,  single  photodetector. 

The  experimental  set-up  for  the  gain-modulated  image  intensifier  approach  is  shown  in  Fig.  6: 
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Figure  6.  Experimental  configuration  for  acousto-optic  detection  with  gain-modulated  image  intensifier 

The  configuration  is  similar  to  that  described  in  Figure  1 ,  except  that  the  extension  tube  has  been  removed 
since  we  now  want  to  collect  the  optical  signal  over  a  much  larger  optical  area  (several  cm2)  rather  than 
focusing  on  individual  speckles.  Based  on  our  previous  experiments  with  the  silicon  photodiode  we  used  the 

coherent  source,  rather  than  the  halogen  lamp,  since  it  provided  a  more  stable  CW  source.  The  coherence  of 
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the  source  is  not  relevant  here  since  we  are  not  observing  speckle  contrast  but  rather  the  modulated  photon 
intensity  via  ultrasound-modulation  of  the  optical  attenuation.  Figure  6  shows  the  driving  signals  to  the 
ultrasound  (blue)  and  the  image-intensifier  (yellow)  for  the  two  cases  of  in  phase  (AO=0°)  and  out  of  phase 
(AO=180°).  For  quadrature  detection,  by  definition,  four  phase  measurements  are  generally  required  as 
described  above.  However,  here  we  intentionally  phase-aligned  the  signals  for  the  special  case  that  the 
maximum  and  minimum  signals  coincided  with  AO=0°  and  AO=180°  respectively.  As  such,  the  amplitude  of  the 
acousto-optic  effect  is  simply  the  difference  between  the  two  measurements.  The  image  intensifier’s 
microchannel  plate  (MCP)  was  set  to  a  voltage  of  260  V  (low)  and  the  CCD  integration  time  was  set  to  320  ms 
per  frame.  Several  images  were  then  acquired  for  A0=O°  before  switching  to  A0=18O°  and  finally  with  the 
ultrasound  turned-off  as  a  control.  The  resultant  CCD  images  were  then  spatially  integrated  and  the  intensity 
values,  I,  are  displayed  in  Fig  7: 


AO  =  0°  AO  =180° 


Figure  7:  Detection  of  US-modulated  photons  with  Gain-modulated  image  intensifier 


This  result  clearly  demonstrates  that  ultrasound-modulation  causes  a  decrease  in  the  local  optical  attenuation 
when  A0=O°  resulting  in  higher  intensity,  and  an  increase  in  the  local  optical  attenuation  when  A0=18O° 
resulting  in  lower  intensity,  compared  to  the  local  optical  attenuation  and  intensity  when  no  ultrasound  is 
applied.  Note,  we  still  switched  the  detector’s  phase  back  and  forth  when  no  ultrasound  was  applied  as  a 
further  control.  Also,  the  intensity  obtained  without  US  being  applied  is  midway  between  AO=0°  and  AO=180° 
as  expected.  The  modulation  in  the  optical  intensity  due  to  ultrasound  can  best  be  represented  by  the  induced 
modulation  depth,  M,  equal  to  (IAOO°  -  IA018O°)/(IAOO°  +  IA01800)  which  here  is  approximately  3%. 


This,  to  our  knowledge,  is  the  first  detection  of  ultrasound-modulated  photons  using  a  gain-modulated  image 
intensifier  phase  detection  approach. 


Ultrasound-Modulated  Fluorescence 


The  detection  of  ultrasound-modulated  fluorescence  would  promote  acousto-optic  imaging  to  acousto-optic 
molecular  imaging  with  the  use  of  targeted  fluorophore-based  optical  probes.  As  mentioned  above, 
fluorescence  is  an  incoherent  phenomenon  and  we  had  previously  detected  ultrasound-modulation  of 
incoherent  photons  with  the  silicon  photodetector  (Fig.  3).  However,  this  had  employed  a  100W  halolgen  lamp 
which  is  many  orders  of  magnitude  brighter  than  a  typical  fluorescence  signal,  nW.  Hence,  although  we  did 
attempt  it,  it  was  not  surprising  that  we  were  unable  to  detect  a  fluorescence  signal  with  the  silicon 
photodetector.  Fluorescence  detection  usually  requires  a  more  sensitive  optical  detector,  such  as  a 
photomultiplier  tube  (PMT)  or  microchannel  plate  (MCP),  due  to  the  low  quantum  yield  of  common 
fluorophores.  To  our  knowledge  only  two  other  groups  [7,  8]  have  recently  reported  on  the  detection  of 
ultrasound-modulated  fluorescence  and  both  used  a  single  detector  as  opposed  to,  and  without  the  benefits  of, 
our  large  area,  multi-pixel  image  intensifier.  We  have  previously  used  our  image  intensifier  to  detect  time 
domain  fluorescence  signals[9]  and  now  planned  to  use  it  to  detect  ultrasound-modulated  fluorescence.  We 
chose  a  small  cylindrical  fluorescent  pellet,  15  mm  diameter  by  8  mm  height,  containing  the  fluorophore 
Qdot800  (Invitrogen,  CA)  at  10  pM  concentration.  Our  manufacture  of  such  pellets  is  reported  elsewhere[10]. 
The  fluorescent  pellet  was  placed  on  the  side  of  the  water  tank  in  the  line  of  sight  between  the  laser  diode  and 
optical  detector  to  which  we  had  added  a  wavelength  filter  (OmegaFilters)  to  block  detection  of  the  laser  diode 
excitation  light  and  permit  detection  of  fluorescence  from  the  fluorescent  pellet  (see  Fig.  8). 
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Figure  8:  Experimental  set-up  for  detection  of  ultrasound-modulated  fluorescence 

Due  to  the  weak  fluorescence  signal  we  increased  the  MCP  voltage  to  510  V  (medium)  and  acquired  several 
images  with  an  integration  time  of  320  ms  at  A0=O°  before  switching  to  A0=18O°.  The  resultant  CCD  images 
were  then  integrated  and  the  intensity  values  are  displayed  in  Fig  9: 


Figure  9:  Detection  of  US-modulated  fluorescence  with  Gain-modulated  image  intensifier 

This  result  demonstrates  the  detection  of  ultrasound-modulated  fluorescence  with  the  gain-modulated  image 
intensifier.  Note  the  modulation  depth  is  much  weaker,  approximately  0.2  %,  compared  to  that  measured  from 
excitation  photons  (see  Figure  7)  and  is  expected  since  we  now  have  a  weaker  fluorescence  signal.  Indeed,  at 
these  low  light  levels  a  systematic  downwards  drift  in  the  detector’s  response  is  also  evident.  This  is  not  a 
concern  since  simple  data-processing  can  remove  this  baseline  effect.  As  before,  without  the  ultrasound  being 
applied  there  was  no  modulation  detected.  It  should  be  noted  that  the  fluorescent  pellet  is  actually  located  just 
after  the  ultrasound  focal  zone  and  closer  to  the  detector  to  ensure  a  strong  detected  optical  signal,  rather  than 
submerged  within  the  focal  zone  itself.  As  such,  the  fluorescence  photons  are  not  being  modulated  per  se,  but 
rather  the  excitation  photons  from  the  laser  diode  are  being  modulated  just  before  the  pellet  which  then 
induces  a  modulation  in  the  fluorescence  signal.  Indeed,  even  if  the  fluorescent  pellet  and  focal  zone  were 
exactly  co-localized  the  dominant  modulation  of  the  resultant  fluorescence  signal  would  be  due  to  modulation 
of  the  excitation  photons  rather  than  modulation  of  the  emitted  fluorescence  photons  themselves.  One  can 
consider  the  continuous  wave  photons  from  the  optical  source  forming  a  localized  modulated  optical  source  in 
the  ultrasound  focal  zone  which,  when  in  close  proximity  of  a  fluorophore,  generates  a  modulated  fluorescence 
signal  which  would  otherwise  be  a  steady-state  fluorescence  signal.  Hence,  there  is  potential  to  image 
fluorophore  distribution  with  ultrasound  spatial  resolution.  It  should  be  noted  that  a  slight  misalignment  in  the 
US  focal  zone  proximity  to  the  fluorescent  pellet  led  to  a  total  loss  of  the  modulated  fluorescence  signal 
demonstrating  that  the  method  should  provide  a  very  high  spatial  resolution  (~mm). 

This,  to  our  knowledge,  is  the  first  detection  of  ultrasound-modulated  fluorescence  photons  using  a  gain- 
modulated  image  intensifier  phase  detection  approach.  We  subsequently  published  these  quadrature  detection 
results  in  Open  Optics[1 1], 
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Second  Year 


Task  3.  Prove  that  microbubble-based  US  contrast  agents  can  increase  the  photon  modulation  and 
result  in  higher  SNR  in  regions  containing  microbubbles. 

This  highly  innovative  and  novel  approach  addresses  the  major  problem  of  acousto-optic  imaging,  namely  the 
very  low  signal  from  modulated  photons  in  the  overwhelming  presence  of  un-modulated  photons  which  has 
hindered  its  translation  to  high  optical  scattering  in  vivo  applications.  We  present  the  modulation  of 
microbubbles  by  ultrasound,  which  is  known  to  induce  large  oscillatory  volumes  changes  of  the  microbubbles 
[12],  which  here  we  expect  to  dramatically  increase  the  photon  modulation  due  to  large  modulation  of  the  local 
optical  properties.  To  test  this  hypothesis  we  modified  the  experimental  set-up  shown  in  figure  2a  by 
submerging  a  quartz  cuvette  (1 2.5x1 2.5x68mm)  in  the  US  focal  zone  of  a  2.25  MHz  transducer  driven  at  1 .5 
MHz.  We  also  prepared  Definity  (FDA  approved  US  contrast  agent,  Bristol-Myers  Squibb  Medical  Imaging)  per 
manufacturer’s  instruction  and  then  filled  a  1-mL  syringe  and  allowed  the  microbubbles  to  settle.  By  obtaining 
samples  from  the  syringe  at  different  depths  we  obtained  three  suspensions  of  small  (least  buoyant)  ~1pm, 
medium  ~2pm,  and  large  (most  buoyant)  ~3pm  microbubbles.  Each  microbubble  suspension  was  placed  in  the 
cuvette  individually  and  the  corresponding  AO  signal  measured.  Between  different  suspensions  the  cuvette 
was  washed  thoroughly  with  pure  saline  for  which  we  also  measured  the  AO  signal  as  a  control.  Fig.  10a 
shows  the  detected  AO  modulation  in  the  frequency  domain  where  it  can  be  seen  that  there  is  a  significant 
increase  in  the  photon  modulation  at  the  fundamental  frequency  (1.5  MHz)  for  all  microbubble  suspensions 
compared  to  the  saline.  Furthermore,  higher  order  harmonics  are  observed  at  3  and  4.5MHz  for  the  medium 
and  large  microbubbles.  Fig.  10b  quantifies  the  significant  dB  gain  of  the  modulated  photons  beyond  the  saline 
control  by  the  addition  of  microbubbles. 
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Fig.  10b  Signal  increase  with  addition  of  microbubbles 


This,  to  our  knowledge,  is  the  first  demonstration  of  the  ultrasound-modulated  photon  signal  being  amplified  by 
microbubbles  and  the  additional  modulation  at  higher  harmonics.  This  harmonic  signature  can  be  used  to 
specifically  identify  the  microbubbles. 

Through  collaboration  with  the  Electrical  and  Computer  Engineering  department  at  UCSD  we  also  explored 
using  their  novel  photon  detector  technology,  known  as  a  single  photon  avalanche  diode  (SPAD)  detector  [13], 
to  detect  ultrasound-modulated  photons.  We  used  the  experimental  setup  in  Fig.  2a  and  replaced  the  silicon 
photo-detector,  amplifier,  high-pass  filter,  and  scope  with  a  7-pm  SPAD,  counter  and  computer  to  display 
photon  counts  over  time.  We  also  used  a  5mW,  532nm  laser  given  this  SPAD  is  more  sensitive  at  these 
shorter  wavelengths.  Despite  the  SPAD’s  small  detection  area  (7-pm)  we  were  able  to  clearly  detect  the 
modulated  optical  signal  in  the  SPAD’s  time-of-arrival  count  histogram  (Fig.  11a).  A  Fourier  transform  of  this 
signal  (Fig.  11b)  shows  the  expected  peak  at  1  MHz  (the  US  frequency).  In  principle,  the  larger  active  area  of  a 
2D  SPAD  array  should  capture  many  more  photons  increasing  SNR. 
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This,  to  our  knowledge,  is  the  first  detection  of  ultrasound-modulated  photons  with  a  SPAD.  The  microbubble 
and  SPAD  results  was  recently  presented[14,  15]  and  published  in  the  SPIE  proceedings[15]. 

Task  4.  Prove  that  fluorophores  attached  to  microbubbles  will  result  in  modulation  of  the  photons  at 
the  emission  frequency. 

As  presented  in  task  2,  we  have  already  demonstrated  the  detection  of  ultrasound-modulated  photons  at  the 
fluorescence  emission  frequency[4,  11]  and  now  plan  to  develop  and  employ  fluorophore-based  microbubbles. 
To  this  end,  Dr.  Goodwin,  a  UCSD  colleague  in  the  Nanoengineering  department,  recently  labeled 
microbubbles  with  the  fluorophore  Nile  Red  (Invitrogen,  CA).  Figure  12  shows  a  fluorescence  microscope 
image  of  these  fluorescent  microbubbles. 


Fig.  12  Microscope  image  of  fluorophore-labeled  microbubbles 

Next  steps  are  to  optimize  the  fluorescent  microbubble  formulation  and  demonstrate  pressure  modulation 
(ultimately  via  ultrasound)  of  the  microbubbles  to  change  their  size  to  induce  self-quenching  of  the  fluorophore 
to  modulate  the  fluorescence  intensity.  In  addition  to  fluorophore  self-quenching,  we  also  plan  to  explore  using 
a  fluorescence  resonance  energy  transfer  (FRET)  pair  on  the  microbubbles  and  modulating  the  FRET 
efficiency  with  ultrasound-modulation  of  the  microbubbles  to  change  the  donor-acceptor  distance.  Since  task  3 
demonstrated  that  microbubbles  also  generate  higher  harmonic  modulations  we  also  expect  to  detect  these 
higher  harmonic  modulations  in  the  fluorescence  signal.  Finally,  we  want  to  detect  the  ultrasound-modulation 
of  fluorescence  from  fluorescent  microbubbbles  in  tissue-like  media  to  demonstrate  this  approach  is  viable  for 
in  vivo  applications. 

KEY  RESEARCH  ACCOMPLISHMENTS 

First  Year 

1.  Detection  of  ultrasound-modulated  incoherent  photons. 

2.  Novel  quadrature  detection  of  ultrasound-modulated  photons  with  a  gain-modulated  image-intensified  CCD. 

3.  Novel  quadrature  detection  of  ultrasound-modulated  fluorescence  photons  with  a  gain-modulated  image- 
intensified  CCD. 
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Second  Year 

4.  Significant  increase  of  ultrasound-modulated  photons  with  microbubbles. 

5.  Generation  of  higher  harmonic  ultrasound-modulated  photons  with  microbubbles. 

6.  Detection  of  ultrasound-modulated  photons  with  SPAD  detector. 

REPORTABLE  OUTCOMES 

Publications,  Presentations,  and  Patent  Applications: 

First  Year 

D.  J.  Hall  and  U.  Sunar,  A  novel  acousto-optic  molecular  imaging  system  for  fluorescence-based  probes. 

Joint  (SMI&AMI)  Molecular  Imaging  Conference,  Oral  Presentation  0070,  (2007). 

(Triple  blind  peer-review  scored  as  one  of  the  Top  Ten  conference  abstracts  out  of  -1000  presentations). 

Second  Year 

D.  J.  Hall,  U.  Sunar,  and  S.  Farshchi-Heydari,  “Quadrature  detection  of  ultrasound-modulated  photons  with  a 
gain-modulated,  image-intensified,  CCD  camera”  Open  Optics  2,  75-78  (2008).  (see  Appendix  for  paper). 

M.  Hsu,  D.  J.  Hall,  S.  Farshchi-Heydari,  S.  Esener,  and  R.  F.  Mattrey,  "Novel  Acousto-Optic  Signal 
Augmentation  using  Microbubbles,"  Poster  Presentation  0366,  WMI  (2008). 

D.  J.  Hall,  M.  Hsu,  S.  Esener,  and  R.  F.  Mattrey,  “Detection  of  ultrasound-modulated  photons  and 
enhancement  with  ultrasound  microbubbles,” Proc.  SPIE,  Vol.  7177,  71771L  (2009).  (see  Appendix  for  paper). 

Patent  Application,  D.  J.  Hall,  “Detection  of  ultrasound-modulated  photons  with  a  gain-modulated  image- 
intensified  CCD  camera,"  (2008). 

Patent  Application,  D.  J.  Hall  and  R.  F.  Mattrey,  “Enhancement  of  Acousto-Optic  Signal  Using  Microbubbles, " 
(2008). 

Grants  Applied  for: 

First  Year 

NIH:  U54  RFA-CA-08-002  NTR:  Optical  Imaging  in  Multimodal  Platforms. 

“High  Resolution  Optical-Ultrasound  (OPUS  1)  Molecular  Imaging  in  Breast  Cancer 
R.  Mattrey  and  D.  Hall  (Co-PIs).  Employed  research  supported  by  this  award  as  Preliminary  Data. 

Second  Year 

NIH:  R01  PAR07-214:  Academic-Industrial  Partnerships  for  Development  and  Validation  of  In  Vivo  Imaging 
Systems  and  Methods  for  Cancer  Investigations. 

“Development  of  Dual  Optics/Ultrasound  (OPUS)  Imaging  System  and  its  Contrast  Media” 

R.  Mattrey  and  D.  Hall  (Co-PIs).  Employed  research  supported  by  this  award  as  Preliminary  Data. 

CONCLUSION 

The  first  year  of  this  research  project  involved  the  detection  of  ultrasound-modulated  incoherent  photons, 
based  on  the  principle  of  modulating  the  optical  attenuation,  followed  by  the  novel  quadrature  detection  of 
ultrasound-modulated  photons  and  fluorescence  photons  with  a  gain-modulated  image  intensified  CCD.  This 
research  demonstrates  the  potential  to  perform  acousto-optic  imaging  with  incoherent  and  fluorescence 
photons  providing  novel  opportunities  for  in  vivo  acousto-optic  molecular  imaging  based  on  endogenous 
contrast  and  fluorescent  probes.  This  cutting-edge  research  was  presented  at  the  Joint  Molecular  Imaging 
conference^]  and  peer-review  rated  as  one  of  the  top  ten  abstracts  out  of  -1000  presentations.  This  work  was 
subsequently  recently  published  in  Open  Optics[11]  with  a  corresponding  patent  application. 


13 


In  the  second  year  of  this  research  project  we  demonstrated  that  microbubbles  dramatically  enhance  AO 
photon  modulation  at  both  the  fundamental  and  higher  order  harmonic  frequencies.  This  signal  enhancement 
should  greatly  improve  detection  of  ultrasound-modulated  photons  especially  for  challenging,  highly  scattering, 
in  vivo  environments.  Furthermore,  the  specific  harmonic  signature  of  microbubbles  will  help  identify  and 
discriminate  them  from  ultrasound-modulation  of  native  tissue  optical  properties  leading  to  high  specificity  with 
targeted  microbubbles.  Moreover,  ultrasound-modulated  fluorescence  from  fluorophores  in  the  vicinity  (or 
attached)  to  microbubbles  should  also  be  encoded  with  their  harmonic  signature  thus  differentiating  them  from 
fluorophores  not  in  the  vicinity  of  microbubbles.  A  corresponding  patent  application  has  been  filed.  Meanwhile, 
novel  detection  of  ultrasound-modulated  photons  with  a  SPAD,  through  collaboration  with  the  UCSD  ECE 
department,  offers  the  potential  for  high  photon  count  rate,  sensitivity,  and  large  sampling  area  from  future  2D 
SPAD  arrays  to  provide  strong  signal  for  in  vivo  AO  detection  of  ultrasound-modulated  photons  with  clinically- 
viable  acquisition  times.  The  above  results  were  presented[14,  15]  and  recently  published[15]  in  the  SPIE 
proceedings.  We  are  now  requesting  a  no-cost  extension  to  complete  the  final  task  4  of  this  research  project 
which  investigates  the  modulation  of  fluorescently-labeled  microbubbles. 

Ultimately,  acousto-optic  imaging  could  be  used  to  diagnose  prostate  cancer  in  vivo  based  on  optical  contrast 
of  endogenous  hypoxia  and/or  cancer-targeted  fluorescent  microbubbles  at  ultrasound  spatial  resolution.  We 
have  submitted  NIH  grant  proposals  to  fund  the  development  of  a  clinical  prototype. 
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Abstract:  Acousto-optic  imaging  promises  to  provide  in  vivo  images  of  optical  contrast  but  with  the  superior  spatial  reso¬ 
lution  of  ultrasound  imaging.  Here  we  present  novel  quadrature  detection  of  ultrasound-modulated  photons  with  a  gain- 
modulated,  image-intensified,  CCD  camera.  The  additional  detection  of  ultrasound-modulated  fluorescence  photons  dem¬ 
onstrates  potential  for  in  vivo  acousto -optic  molecular  imaging. 

Keywords:  Acousto-optic,  fluorescence,  ultrasound. 


INTRODUCTION 

In  the  last  several  years  there  has  been  rapid  growth  in 
the  optical  molecular  imaging  of  small  animals  in  vivo  [1]. 
Longitudinal  studies  can  now  be  performed  employing  opti¬ 
cal  probes  based  on  bioluminescence  and  fluorescence  mark¬ 
ers  [2].  Nevertheless,  optical  imaging  suffers  from  the  inher¬ 
ent  high  scattering  of  optical  photons  by  biological  tissue 
resulting  in  centimeter  spatial  resolution  for  applications 
such  as  optical  breast  imaging  [3].  To  address  this  issue  re¬ 
searchers  are  combining  optics  and  ultrasound  to  provide 
optical  images  at  superior  ultrasound  spatial  resolution 
(mm).  One  popular  approach  is  opto-acoustic  imaging  [4] 
which  provides  optical  absorption  images  at  ultrasound  reso¬ 
lution.  An  alternative  combination  of  optics  and  ultrasound 
is  acousto-optic  imaging  [5].  This  approach  involves  the 
modulation  of  photons,  at  the  ultrasound  frequency,  which 
propagate  through  a  small  ultrasound  focal  zone.  Optical 
images  generated  from  only  these  ultrasound-modulated 
photons  will  thus  have  the  improved  spatial  resolution  of  the 
ultrasound  focal  zone.  The  main  challenge  is  the  detection 
and  discrimination  of  ultrasound-modulated  photons  from 
the  overwhelming  presence  of  non-modulated  photons  not 
passing  through  the  ultrasound  focal  zone.  To  date,  most 
researchers  have  employed  coherent  light  sources  and  detect¬ 
ing  ultrasound-modulated  speckles  [6,  7].  To  increase  the 
SNR  of  the  modulated  signal  a  large  number  of  speckles 
must  be  detected.  However,  since  the  detected  speckles 
modulate  at  the  same  frequency  but  with  random  phase,  a 
direct  spatial  integration  of  the  speckles  would  lead  to  a  loss 
of  modulation.  Instead,  parallel  detection  techniques  employ 
a  coherent  light  source  modulated  at  the  ultrasound  fre¬ 
quency  and  detect  the  ultrasound-modulated  speckles  with  a 
CCD  camera  [8].  Quadrature  detection,  i.e.  acquiring  CCD 
images  of  speckles  at  four  different  phase  shifts  between  the 
laser  and  ultrasound  modulation,  permits  the  modulation 
amplitude  of  each  speckle  to  be  determined  which  summed 
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over  all  speckles  leads  to  an  increase  in  SNR.  Researchers 
have  also  elucidated  on  the  physical  process  of  ultrasound- 
modulation  of  coherent  photons  [9,  10].  The  requirement  for 
coherence  limits  the  choice  of  light  sources  to  those  with  a 
coherence  length  at  least  as  long  as  the  optical  pathlength 
(several  centimeters  for  highly  scattering  biological  tissue), 
as  well  as  high  imaging  spatial  resolution  (order  of  microns) 
to  resolve  individual  speckles,  and  prohibits  the  modulation 
of  incoherent  processes  such  as  fluorescence. 

More  recently  researchers  have  reported  detection  of  ul¬ 
trasound-modulated  incoherent  photons  [11].  Here,  the  ultra¬ 
sound  modulates  the  optical  properties  (refractive  index, 
absorption,  scattering)  of  the  ultrasound  focal  zone  resulting 
in  a  modulation  of  the  local  optical  attenuation  coefficient 
causing  an  in-phase  intensity  modulation  of  the  photons  (be 
they  incoherent  or  coherent).  In  essence,  it  can  be  considered 
as  generating  a  modulated  light  source  at  the  ultrasound  fre¬ 
quency  in  the  focal  zone.  The  detection  of  the  in-phase  in¬ 
tensity  modulation  does  not  require  the  high  imaging  spatial 
resolution  needed  to  resolve  the  random  phase  speckles  from 
coherent  photons  and  permits  direct  spatial  integration  of  the 
detected  photons.  Here  we  present  our  novel  parallel  detec¬ 
tion  approach  and  preliminary  results  demonstrating  detec¬ 
tion  of  ultrasound-modulated  photons  and  fluorescence. 

METHOD 

The  detection  of  ultrasound-modulated  photons  has  em¬ 
ployed  photomultiplier  tubes  (PMTs)  which  have  adequate 
bandwidth  to  measure  the  MHz  modulation  frequency  but 
limited  detection  area.  Unfortunately  larger  area  detectors, 
such  as  CCD  cameras,  have  inadequate  frame  rates  (Hz)  to 
capture  the  MHz  signal.  However,  CCD  cameras  have  been 
employed  in  parallel  detection  quadrature  methods  by  cross- 
correlating  the  ultrasound  modulation  with  a  laser  modulated 
at  the  ultrasound  frequency  and  acquiring  CCD  images  at 
four  different  phase  shifts  [8].  We  have  developed  an  alter¬ 
native,  novel,  parallel  quadrature  detection  approach  where 
the  laser  is  steady-state  and  the  ultrasound  modulation  is 
cross-correlated  with  an  image- intensified  CCD  camera 
which  is  gain-modulated  at  the  ultrasound  frequency  and 
CCD  images  are  acquired  at  four  different  phase  shifts.  In 
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Fig.  (1).  Configuration  for  detection  of  ultrasound-modulated  photons  with  a  gain-modulated,  image-intensified,  CCD  camera.  1  MHz  driv¬ 
ing  signals  for  US  transducer  and  Image  Intensifler  gain  shown  (top  right)  for  relative  phase  shifts  of  0°and  180°. 


other  words,  we  are  cross-correlating  the  ultrasound  and  the 
optical  detector  using  a  steady-state  source  as  opposed  to 
cross-correlating  the  ultrasound  and  the  optical  source  using 
a  steady-state  detector  [8].  The  experimental  configuration  is 
shown  in  Fig.  (1). 

In  this  setup  we  employed  a  laser  diode  (5  mW  at  650 
nm)  to  illuminate  a  water  tank  (65  mm  wide)  to  which  we 
added  varying  amounts  of  intralipid  as  an  optical  scatterer. 
Light  was  detected  with  a  gain-modulated  image  intensifler 
(Picostar  HRI,  LaVision,  Germany)  with  a  highly  sensitive 
electron-multiplying  CCD  camera  (Andor,  CA)  to  detect  the 
output  of  the  image  intensifler  and  store  it  on  the  acquisition 
computer.  Modulation  of  the  image  intensifier  gain  was 
achieved  with  a  function  generator  (Stanford  Research  Sys¬ 
tems,  DS345)  outputting  a  sine  wave  at  the  ultrasound  fre¬ 
quency  and  phase-locked  to  a  second  identical  function  gen¬ 
erator  input  to  an  RF  Amplifier  (ENI,  240L)  to  drive  a  sin¬ 
gle-element  ultrasound  transducer  (Panametrics,  V303)  with 
a  1  MHz  sine  wave  (50  Vpp)  with  20  pulses  (20  ps  pulse- 
length)  every  millisecond  (2%  duty  cycle).  The  phase  shift, 
AO,  between  the  image  intensifier  gain  and  ultrasound  trans¬ 
ducer  can  be  varied  from  0  to  2n.  Fig.  (1)  shows  the  driving 
signals  for  the  image  intensifier  gain  (yellow)  and  the  ultra¬ 
sound  transducer  (blue)  for  the  two  conditions  of  AO=0°  and 
AO=180°.  The  ultrasound  transducer  was  submerged  in  the 
water  tank  such  that  its  focal  zone  (100  KPa  peak  pressure) 
intercepted  the  line-of-sight  between  the  laser  diode  (~0.1 
mW  in  focal  zone)  and  the  image  intensifier  in  transmission 
mode.  A  50  mm  f/1.4  Lens  (Nikon)  permitted  photon  detec¬ 
tion  over  a  large  area  (several  cm2). 

RESULTS 

Quadrature  Detection  of  Ultrasound-Modulated  Photons 

The  image  intensifier’ s  microchannel  plate  (MCP)  was 
set  to  a  voltage  of  260  V  (low  gain)  and  the  CCD  integration 
time  was  set  to  320  ms  per  frame.  Several  images  were  then 
acquired  for  AO=0°  before  switching  to  AO=180°  and  finally 
with  the  ultrasound  turned-off  as  a  control.  For  quadrature 
detection  we  generally  require  four  phase  measurements. 
However,  here  we  intentionally  phase- aligned  the  signals  for 
the  special  case  that  the  maximum  and  minimum  signals 
coincided  with  AO=0°  and  AO=180°  respectively.  As  such, 
the  amplitude  of  the  acousto-optic  effect  is  simply  the  differ- 
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ence  between  the  two  measurements.  Each  CCD  image  was 
spatially  integrated,  since  the  intensity  modulation  was  in- 
phase,  and  the  intensity  values,  I,  were  plotted  (Fig.  2).  Note, 
similar  to  other  researchers  [8],  this  approach  would  also  be 
applicable  to  parallel  quadrature  detection  of  ultrasound- 
modulated  speckles  from  coherent  photons. 

Fig.  (2)  shows  that  ultrasound-modulation  causes  a  de¬ 
crease  in  the  local  optical  attenuation  when  AO=0°  resulting 
in  higher  intensity,  and  an  increase  in  the  local  optical  at¬ 
tenuation  when  AO=180°  resulting  in  lower  intensity,  com¬ 
pared  to  the  local  optical  attenuation  and  intensity  when  no 
ultrasound  is  applied.  We  continued  to  switch  the  detector’s 
phase  back  and  forth  when  no  ultrasound  was  applied  as  a 
further  control.  Also  it  was  noted  that  the  intensity  obtained 
without  ultrasound  being  applied  is  midway  between  AO=0° 
and  AO=180°  as  expected.  The  modulation  in  the  optical 
intensity  due  to  ultrasound  can  best  be  represented  by  the 
induced  modulation  depth,  M,  equal  to  (IAO0°  - 
IA018O°)/(IA0O°  +  IAO180°)  which  here  is  approximately 
3%. 


AO  =  0°  AO  =  180° 


Fig.  (2).  Detection  of  ultrasound-modulated  photons  with  3  % 
modulation  depth.  Recorded  Intensity  for  relative  phase  shifts  of 
0°and  180°  with  and  without  ultrasound  applied. 
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Quadrature  Detection  of  Ultrasound-Modulated  Fluores¬ 
cence 

To  investigate  whether  we  could  detect  ultrasound- 
modulated  fluorescence  we  used  a  small  cylindrical  fluores¬ 
cent  pellet,  15  mm  diameter  by  8  mm  height,  containing  the 
fluorophore  Qdot800  (Invitrogen,  CA)  at  10  pM  concentra¬ 
tion.  Our  manufacture  of  such  pellets  is  reported  elsewhere 
[12].  The  fluorescent  pellet  was  placed  on  the  side  of  the 
water  tank  in  the  line  of  sight  between  the  laser  diode  and 
optical  detector  to  which  we  had  added  a  wavelength  filter 
(OmegaFilters,  780  LP)  to  block  laser  excitation  light  and 
permit  detection  of  fluorescence  from  the  fluorescent  pellet. 
Due  to  the  weak  fluorescence  signal  we  increased  the  MCP 
voltage  to  510  V  (medium  gain)  and  acquired  several  images 
with  an  integration  time  of  320  ms  at  AO=0°  before  switch¬ 
ing  to  AO=180°.  The  resultant  CCD  images  were  then  inte¬ 
grated  and  the  intensity  values  are  displayed  in  Fig.  (3). 


Fig.  (3).  Detection  of  ultrasound-modulated  fluorescence.  Recorded 
Fluorescence  Intensity  for  relative  phase  shifts  of  0°  (peaks)  and 
180°  (troughs). 

This  result  demonstrates  the  detection  of  ultrasound- 
modulated  fluorescence  with  the  gain-modulated  image  in- 
tensifier.  Note  the  modulation  depth  is  much  weaker,  ap¬ 
proximately  0.2  %,  compared  to  that  measured  from  excita¬ 
tion  photons  (Fig.  2).  Systematic  downwards  drift  is  due 
primarily  to  small  laser  and  detector  drifts  we  observed  dur¬ 
ing  our  measurements  with  and  without  ultrasound  modula¬ 
tion.  This  drift  was  not  a  concern  since  modulation  depth 
was  the  main  interest  and  simple  data-processing  can  remove 
this  baseline  effect.  As  before,  without  the  ultrasound  being 
applied  there  was  no  modulation  detected.  It  should  be  noted 
that  the  fluorescent  pellet  is  actually  located  just  after  the 
ultrasound  focal  zone  and  closer  to  the  detector  to  ensure  a 
strong  detected  optical  signal,  rather  than  submerged  within 
the  focal  zone  itself.  As  such,  the  fluorescence  photons  are 
not  being  modulated  per  se,  but  rather  the  excitation  photons 
from  the  laser  diode  are  being  modulated  just  before  the  pel¬ 
let  which  then  induces  a  modulation  in  the  fluorescence  sig¬ 
nal.  Indeed,  even  if  the  fluorescent  pellet  and  focal  zone 
were  exactly  co-localized  the  fluorescence  modulation  would 
be  due  to  modulation  of  both  the  excitation  photons  and 
emitted  fluorescence  photons.  Again  it  is  useful  to  consider 
the  continuous  wave  photons  from  the  optical  source  as 
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sound  focal  zone  which,  when  in  close  proximity  of  a 
fluorophore,  generates  a  modulated  fluorescence  signal 
which  would  otherwise  be  a  steady-state  fluorescence  signal. 
Hence,  there  is  potential  to  image  fluorophore  distribution 
with  ultrasound  spatial  resolution.  It  should  be  noted  that  a 
slight  misalignment  in  the  ultrasound  focal  zone  proximity  to 
the  fluorescent  pellet  led  to  a  total  loss  of  the  modulated 
fluorescence  signal  demonstrating  that  the  method  should 
provide  a  very  high  spatial  resolution  (~mm). 

Beyond  the  quadrature  detection  of  ultrasound-modulated 
photons  demonstrated  here,  we  plan  to  perform  acousto-optic 
imaging  with  this  detection  approach.  The  laser  and  ultra¬ 
sound  focal  zone  will  be  raster- scanned  across  an  optically 
scattering  object  and  the  amplitude  of  the  ultrasound- 
modulated  photons  measured  for  each  scan  position  to  pro¬ 
vide  an  image.  For  a  homogeneous  object  we  expect  constant 
amplitude,  whereas  scanning  across  a  more  optically  attenu¬ 
ating  inhomogeneity  we  expect  a  decrease  in  amplitude.  Al¬ 
ternatively,  in  fluorescence  imaging  mode  scanning  across  a 
fluorescent  inhomogeneity  we  expect  an  increase  in  ampli¬ 
tude  due  to  the  detection  of  ultrasound-modulated  fluores¬ 
cence  photons.  Since  only  photons  within  the  small  ultra¬ 
sound  focal  zone  are  modulated  and  contribute  to  the 
acousto-optic  images  we  expect  much  higher  image  spatial 
resolution  than  achievable  from  optical  imaging  which  em¬ 
ploys  all  detected  photons. 

CONCLUSIONS 

This  work  has  presented  the  novel  quadrature  detection 
of  ultrasound-modulated  photons  with  a  gain-modulated, 
image-intensified  CCD  camera.  Furthermore,  the  detection 
with  this  novel  approach  of  ultrasound-modulated  fluores¬ 
cence,  an  incoherent  process,  offers  the  opportunity  for 
acousto-optic  molecular  imaging  employing  fluorescence- 
based  probes.  Future  work  will  involve  a  scanning  configu¬ 
ration  to  perform  acousto-optic  imaging. 
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ABSTRACT 

In  vivo  acousto-optic  imaging  promises  to  provide  optical  contrast  at  superior  ultrasound  spatial  resolution.  The  main 
challenge  is  to  detect  ultrasound-modulated  photons  in  the  overwhelming  presence  of  un-modulated  photons.  We  have 
demonstrated  in  vitro  detection  of  ultrasound-modulated  photons  with  a  variety  of  detection  methods.  Furthermore,  we 
have  detected  ultrasound-modulated  fluorescence  offering  potential  for  acousto-optic  molecular  imaging.  Moreover,  we 
have  demonstrated  the  use  of  ultrasound  microbubbles  to  significantly  enhance  the  acousto-optic  signal  at  the  ultrasound 
frequency  with  the  additional  generation  of  higher  order  harmonic  frequencies.  Here  the  results  from  our  various 
detection  methods,  ultrasound-modulated  fluorescence,  and  enhancement  with  microbubbles  are  presented. 
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1.  BACKGROUND 

In  vivo  optical  imaging  is  limited  by  the  high  optical  scattering  of  tissue  which  limits  the  spatial  resolution  to  centimeters 
for  applications  such  as  optical  breast  imaging[l].  Researchers  are  combining  optics  and  ultrasound  to  provide  optical 
images  at  superior  ultrasound  spatial  resolution.  A  popular  approach  is  opto-acoustic  imaging  which  provides  optical 
attenuation  images  at  ultrasound  resolution  and  is  described  elsewhere [2].  Alternatively,  acousto-optic  imaging  involves 
the  modulation  of  photons  at  the  ultrasound  frequency  when  they  propagate  through  a  small  ultrasound  focal  zone  [3]. 
Images  generated  from  only  these  ultrasound-modulated  photons,  as  opposed  to  all  detected  photons,  will  have  the 
improved  spatial  resolution  of  the  ultrasound  focal  zone.  The  main  challenge  is  the  detection  and  discrimination  of 
ultrasound-modulated  photons  in  the  overwhelming  presence  of  un-modulated  photons  not  passing  through  the 
ultrasound  focal  zone.  Here  we  present  our  detection  of  ultrasound-modulated  photons  with  a  variety  of  photo-detectors, 
detection  of  ultrasound-modulated  fluorescence,  and  dramatic  signal  enhancement  using  ultrasound  microbubbles. 


2.  METHODS  &  RESULTS 

2.1  Detection  of  ultrasound-modulated  photons  with  a  silicon  photo-detector 

Coherent  Photons 

A  65  mm  wide  tank  containing  water  and  Intralipid  for  optical  scattering  was  illuminated  using  a  laser  diode  (5  mW  at 
650  nm,  coherence  length  ~5M).  Light  was  detected  in  transmission  mode  with  a  silicon  photo-detector  (PDA36A, 
ThorLabs),  amplified  (lOdB  built-in  gain),  filtered  (Stanford  Research  Systems,  SR560)  to  remove  DC  and  low 
frequency  noise  (<10  KHz)  and  recorded  on  a  digital  scope  (Tektronix,  TDS  2012B).  A  function  generator  (Stanford 
Research  Systems,  DS345)  and  RF  Amplifier  (ENI,  240L)  delivered  to  a  single-element  US  transducer  (Panametrics, 
V303,  3cm  focal  length)  a  1  MHz  sine  wave  (20  cycles  at  50Vpp)  every  50ps  (2%  duty  cycle).  The  transducer  was 
submerged  in  water  and  the  light  was  passed  through  the  US  focal  zone  (Fig.  la).  The  local  US  effect  on  water  was 
sufficient  to  modulate  the  optical  properties  that  were  detected  in  the  optical  signal  and  displayed  on  the  scope  (Fig.  lb). 
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A  Fourier  transform  of  this  signal  (Fig.  lc)  shows  a  peak  at  1  MHz  (the  US  frequency)  where  the  amplitude  is 
proportional  to  the  magnitude  of  the  AO  effect.  When,  the  measurement  was  repeated  without  US  there  was  no 
modulation  detected. 
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Fig.  i  (a)  experimental  set-up  (b)  detected  modulated  signal  (time  domain)  (c)  Fourier  transform  peak  at  1  MHz. 


Incoherent  Photons 

Most  previous  AO  research  has  used  coherent  photons  with  US  modulation  of  photon  path-lengths  that  affect  phase  that 
are  detected  as  an  interference  “speckle”  pattern  [3].  The  necessity  for  photon  to  remain  coherent  throughout  their  path 
in  tissues  that  can  easily  reach  six  times  the  tissue  thickness  [4],  requires  lasers  with  long  coherence  length  restricting  the 
choice  of  available  lasers.  We  used  the  experimental  setup  shown  in  Fig  la  but  replaced  the  coherent  light  source  with  an 
incoherent  light  source  (100  W  Halogen  Lamp,  Schott  KL1500)  (Fig  2a).  Fig  2b  shows  the  detected  modulation  of  the 
optical  signal  at  the  US  frequency  of  1  MHz.  One  other  group  [5]  has  also  reported  on  the  modulation  of  incoherent 
photons  which  relies  upon  modulation  of  the  local  optical  attenuation  coefficient  that  will  affect  all  photons  be  they 
coherent  or  incoherent. 


Enhancement  with  Ultrasound  Microbubbles 

A  novel  idea  presented  here  is  the  use  of  microbubbles  to  increase  photon  modulation  to  improve  AO  detection.  The 
modulation  of  microbubbles  by  ultrasound  is  expected  to  dramatically  increase  the  photon  modulation  due  to  large 
oscillatory  volume  changes  of  the  microbubbles  leading  to  large  modulation  of  the  local  optical  properties.  To  test  this 
hypothesis  we  modified  the  experimental  set-up  shown  in  figure  1  by  submerging  a  quartz  cuvette  (12.5x12.5x68mm)  in 
the  US  focal  zone  of  a  2.25  MHz  transducer  driven  at  1.5  MHz.  We  also  prepared  Defmity  (FDA  approved  US  contrast 
agent,  Bristol-Myers  Squibb  Medical  Imaging)  per  manufacturer’s  instruction  and  then  filled  a  1-mL  syringe  and 
allowed  the  microbubbles  to  settle.  By  obtaining  samples  from  the  syringe  at  different  depths  we  obtained  three 
suspensions  of  small  (least  buoyant),  medium,  and  large  (most  buoyant)  microbubbles.  Each  microbubble  suspension 
was  placed  in  the  cuvette  individually  and  the  corresponding  AO  signal  measured.  Between  different  suspensions  the 
cuvette  was  washed  thoroughly  with  pure  saline  for  which  we  also  measured  the  AO  signal  as  a  control.  Fig.  3a  shows 
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the  detected  AO  modulation  in  the  frequency  domain  where  it  can  be  seen  that  there  is  an  increase  in  the  photon 
modulation  at  the  fundamental  frequency  (1.5  MHz)  for  all  microbubble  suspensions  compared  to  the  saline. 
Furthermore,  higher  order  harmonics  are  observed  at  3  and  4.5MHz  for  the  medium  and  large  microbubbles.  Fig.  3b 
quantifies  the  significant  dB  gain  of  the  modulated  photons  beyond  the  saline  control  by  the  addition  of  microbubbles. 


Differential  Signal  from  Water  Baseline 
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Fig.  3b  Signal  increase  with  addition  of  microbubbles 


2.2  Quadrature  Detection  of  ultrasound-modulated  photons  with  a  gain-modulated  image-intensifier 

The  ability  to  measure  ultrasound-modulated  incoherent  photons  offers  the  opportunity  to  measure  ultrasound-modulated 
fluorescence  with  future  potential  for  AO  molecular  imaging  with  fluorescence-based  probes.  To  our  knowledge  only 
two  other  groups  have  detected  US-modulated  fluorescence  [5,  6].  We  also  attempted  to  detect  ultrasound-modulated 
fluorescence  with  our  silicon  photo-detector  but  found  the  fluorescence  signal  too  weak  to  detect.  However,  we  also 
have  a  highly  sensitive  image-intensified  (Pico star,  LaVision,  Germany)  EMCCD  camera  (Andor,  CA)  and  detected 
ultrasound-modulated  fluorescence  using  a  novel  gain-modulated  quadrature  approach  which  is  reported  in  more  detail 
elsewhere  [7].  Basically,  the  optical  detector  is  gain-modulated  at  the  US  frequency  and  the  photon  intensity  is  measured 
as  the  phase  shift,  AO,  between  the  US  and  detector-gain  driving  signals  is  varied.  The  ultrasound-induced  photon 
modulation  can  then  be  recovered  from  just  four  phase  shift  measurements  (quadrature).  Moreover,  by  intentionally 
adjusting  the  phase-shift  such  that  maximum  and  minimum  photon  intensity  is  measured  at  AO=0°  andl80°  respectively, 
the  photon  modulation  is  simply  IAO0°  -  IAOi80°.  For  brevity,  Fig.  4a  shows  the  detection  of  US-modulated  photons  and 
Fig.  4b  shows  the  detection  of  ultrasound-modulated  fluorescence  from  a  Qdot800  (Invitrogen,  CA)  fluorescent  pellet. 
As  expected,  the  fluorescence  signal  is  much  weaker  but  is  nevertheless  detectable. 
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Fig.  4  Detection  of  US-modulated  photons  (a)  and  fluorescence  (b)  with  a  gain-modulated  image  intensifier 
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2.3  Detection  of  ultrasound-modulated  photons  with  a  Photomultiplier  tube 


Detection  of  AO  modulated  photons  has  traditionally  been  done  with  photomultiplier  tubes  due  to  their  good  quantum 
efficiencies  and  high  gains[3].  We  used  a  similar  setup  shown  in  Fig.  la  and  replaced  the  silicon  photo-detector  with  a 
Hamamatsu  HC-125  Analog  PMT  with  8MHz  bandwidth.  Here,  we  used  a  532nm,  5mW  laser  for  better  detector 
sensitivity  and  placed  an  aperture  in  front  of  the  PMT  to  reduce  the  total  photon  flux  to  prevent  detector  saturation.  A 
clear  ultrasound-modulated  light  signal  was  measured  and  is  shown  in  the  time  domain  (Fig.  5a)  and  frequency  domain 
(Fig.  5b). 


Real-time  AO  imaging  will  inevitably  require  photo-detector  arrays  to  detect  larger  numbers  of  ultrasound-modulated 
photons.  Large  arrays  of  PMTs,  however,  are  not  practical  due  their  inability  to  be  cost-effectively  scaled  as  well  as  their 
bulky  and  fragile  nature.  In  the  final  section,  we  present  preliminary  results  demonstrating  feasibility  of  AO  imaging 
with  a  CMOS  SPAD  capable  of  being  scaled  towards  megapixel  arrays  for  a  fraction  of  the  cost  of  a  single  PMT 
detector. 


2.4  Detection  of  ultrasound-modulated  photons  with  a  Single  Photon  Avalanche  Detector  (SPAD) 

To  demonstrate  the  feasibility  of  using  our  SPAD  detector,  described  in  detail  elsewhere  [8],  we  used  the  experimental 
setup  in  Fig.  la  and  replaced  the  silicon  photo-detector,  amplifier,  high-pass  filter,  and  scope  with  our  7- pm  SPAD, 
counter  and  computer  to  display  photon  counts  over  time.  Again,  we  used  a  5mW,  532nm  laser  given  this  SPAD  is  more 
sensitive  at  these  shorter  wavelengths.  Despite  the  SPAD’s  small  detection  area  (7- pm)  we  were  able  to  clearly  detect 
the  modulated  optical  signal  in  the  SPAD’s  time-of-arrival  count  histogram  (Fig.  6a).  A  Fourier  transform  of  this  signal 
(Fig.  6b)  shows  the  expected  peak  at  1  MHz  (the  US  frequency).  In  principle,  the  larger  active  area  of  a  2D  array  should 
capture  many  more  photons  increasing  SNR. 
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3.  CONCLUSION 


These  preliminary  results  demonstrate  our  ability  to  measure  US-modulated  coherent,  incoherent,  and  fluorescence  light 
using  a  variety  of  photo-detectors.  We  believe  that  the  combination  of  the  high  photon  count  rate,  sensitivity,  and  large 
sampling  area  that  will  be  possible  with  SPAD  arrays  will  provide  sufficient  signal  for  in  vivo  AO  detection  of 
ultrasound-modulated  photons  with  clinically- viable  acquisition  times.  Equally  important,  we  showed  that  microbubbles 
dramatically  enhance  AO  photon  modulation  at  both  the  fundamental  and  higher  order  harmonic  frequencies  as  is  known 
to  occur  with  US  imaging[9].  This  signal  enhancement  should  greatly  improve  detection  of  ultrasound-modulated 
photons  especially  for  challenging,  highly  scattering,  in  vivo  environments.  Furthermore,  the  specific  harmonic  signature 
of  microbubbles  will  help  identify  and  discriminate  them  from  ultrasound-modulation  of  native  tissue  optical  properties 
leading  to  high  specificity  with  targeted  microbubbles.  Moreover,  ultrasound-modulated  fluorescence  from  fluorophores 
in  the  vicinity  (or  attached)  to  microbubbles  will  also  be  encoded  with  their  harmonic  signature  thus  differentiating  them 
from  fluorophores  not  in  the  vicinity  of  microbubbles.  In  future  work  we  plan  to  generate  AO  images  and  explore 
fluorophore-labelled  microbubbles. 
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